Nonnegative matrix factorization with quadratic programming

Nonnegative Matrix Factorization (NMF) solves the following problem: find such nonnegative matrices A ∈ RI×J + and X ∈ RJ×K + that Y ∼= AX, given only Y ∈ RI×K and the assigned index J (K >> I ≥ J). Basically, the factorization is achieved by alternating minimization of a given cost function subject to nonnegativity constraints. In the paper, we propose to use Quadratic Programming (QP) to solve the minimization problems. The Tikhonov regularized squared Euclidean cost function is extended with a logarithmic barrier function (which satisfies nonnegativity constraints), and then using second-order Taylor expansion, a QP problem is formulated. This problem is solved with some trust-region subproblem algorithm. The numerical tests are performed on the blind source separation problems.